Good or best practice statements: proposal for the operationalisation and implementation of GRADE guidance.

An evidence-based approach is considered the gold standard for health decision-making. Sometimes, a guideline panel might judge the certainty that the desirable effects of an intervention clearly outweigh its undesirable effects as high, but the body of supportive evidence is indirect. In such cases, the application of the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach for grading the strength of recommendations is inappropriate. Instead, the GRADE Working Group has recommended developing ungraded best or good practice statement (GPS) and developed guidance under which circumsances they would be appropriate.Through an evaluation of COVID-1- related recommendations on the eCOVID Recommendation Map (COVID-19.recmap.org), we found that recommendations qualifying a GPS were widespread. However, guideline developers failed to label them as GPS or transparently report justifications for their development. We identified ways to improve and facilitate the operationalisation and implementation of the GRADE guidance for GPS.Herein, we propose a structured process for the development of GPSs that includes applying a sequential order for the GRADE guidance for developing GPS. This operationalisation considers relevant evidence-to-decision criteria when assessing the net consequences of implementing the statement, and reporting information supporting judgments for each criterion. We also propose a standardised table to facilitate the identification of GPS and reporting of their development. This operationalised guidance, if endorsed by guideline developers, may palliate some of the shortcomings identified. Our proposal may also inform future updates of the GRADE guidance for GPS.

Knowledge mobilization activities to support decision-making by youth, parents, and adults using a systematic and living map of evidence and recommendations on COVID-19: protocol for three randomized controlled trials and qualitative user-experience studies.

INTRODUCTION: The COVID-19 pandemic underlined that guidelines and recommendations must be made more accessible and more understandable to the general public to improve health outcomes. The objective of this study is to evaluate, quantify, and compare the public's understanding, usability, satisfaction, intention to implement, and preference for different ways of presenting COVID-19 health recommendations derived from the COVID-19 Living Map of Recommendations and Gateway to Contextualization (RecMap). METHODS AND ANALYSIS: This is a protocol for a multi-method study. Through an online survey, we will conduct pragmatic allocation-concealed, blinded superiority randomized controlled trials (RCTs) in three populations to test alternative formats of presenting health recommendations: adults, parents, and youth, with at least 240 participants in each population. Prior to initiating the RCT, our interventions will have been refined with relevant stakeholder input. The intervention arm will receive a plain language recommendation (PLR) format while the control arm will receive the corresponding original recommendation format as originally published by the guideline organizations (standard language version). Our primary outcome is understanding, and our secondary outcomes are accessibility and usability, satisfaction, intended behavior, and preference for the recommendation formats. Each population's results will be analyzed separately. However, we are planning a meta-analysis of the results across populations. At the end of each survey, participants will be invited to participate in an optional one-on-one, virtual semi-structured interview to explore their user experience. All interviews will be transcribed and analyzed using the principles of thematic analysis and a hybrid inductive and deductive approach. ETHICS AND DISSEMINATION: Through Clinical Trials Ontario, the Hamilton Integrated Research Ethics Board has reviewed and approved this protocol (Project ID: 3856). The University of Alberta has approved the parent portion of the trial (Project ID:00114894). Findings from this study will be disseminated through open-access publications in peer-reviewed journals and using social media. TRIAL REGISTRATION: Clinicaltrials.gov NCT05358990 . Registered on May 3, 2022.

Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review

Background Hundreds of coronavirus disease 2019 (COVID-19) clinical practice guidelines (CPGs) and expert consensus statements have been developed and published since the outbreak of the epidemic. However, these CPGs are of widely variable quality. So, this review is aimed at systematically evaluating the methodological and reporting qualities of COVID-19 CPGs, exploring factors that may influence their quality, and analyzing the change of recommendations in CPGs with evidence published. Methods We searched five electronic databases and five websites from 1 January to 31 December 2020 to retrieve all COVID-19 CPGs. The assessment of the methodological and reporting qualities of CPGs was performed using the AGREE II instrument and RIGHT checklist. Recommendations and evidence used to make recommendations in the CPGs regarding some treatments for COVID-19 (remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir) were also systematically assessed. And the statistical inference was performed to identify factors associated with the quality of CPGs. Results We included a total of 92 COVID-19 CPGs developed by 19 countries. Overall, the RIGHT checklist reporting rate of COVID-19 CPGs was 33.0%, and the AGREE II domain score was 30.4%. The overall methodological and reporting qualities of COVID-19 CPGs gradually improved during the year 2020. Factors associated with high methodological and reporting qualities included the evidence-based development process, management of conflicts of interest, and use of established rating systems to assess the quality of evidence and strength of recommendations. The recommendations of only seven (7.6%) CPGs were informed by a systematic review of evidence, and these seven CPGs have relatively high methodological and reporting qualities, in which six of them fully meet the Institute of Medicine (IOM) criteria of guidelines. Besides, a rapid advice CPG developed by the World Health Organization (WHO) of the seven CPGs got the highest overall scores in methodological (72.8%) and reporting qualities (83.8%). Many CPGs covered the same clinical questions (it refers to the clinical questions on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir in COVID-19 patients) and were published by different countries or organizations. Although randomized controlled trials and systematic reviews on the effectiveness of treatments of remdesivir, glucocorticoids, hydroxychloroquine/chloroquine, interferon, and lopinavir-ritonavir for patients with COVID-19 have been published, the recommendations on those treatments still varied greatly across COVID-19 CPGs published in different countries or regions, which may suggest that the CPGs do not make sufficient use of the latest evidence. Conclusions Both the methodological and reporting qualities of COVID-19 CPGs increased over time, but there is still room for further improvement. The lack of effective use of available evidence and management of conflicts of interest were the main reasons for the low quality of the CPGs. The use of formal rating systems for the quality of evidence and strength of recommendations may help to improve the quality of CPGs in the context of the COVID-19 pandemic. During the pandemic, we suggest developing a living guideline of which recommendations are supported by a systematic review for it can facilitate the timely translation of the latest research findings to clinical practice. We also suggest that CPG developers should register the guidelines in a registration platform at the beginning for it can reduce duplication development of guidelines on the same clinical question, increase the transparency of the development process, and promote cooperation among guideline developers all over the world. Since the International Practice Guideline Registry Platform has been created, developers could register guidelines prospectively and internationally on this platform.

Guidelines for the prevention and management of children and adolescents with COVID-19.

Children are the future of the world, but their health and future are facing great uncertainty because of the coronavirus disease 2019 (COVID-19) pandemic. In order to improve the management of children with COVID-19, an international, multidisciplinary panel of experts developed a rapid advice guideline at the beginning of the outbreak of COVID-19 in 2020. After publishing the first version of the rapid advice guideline, the panel has updated the guideline by including additional stakeholders in the panel and a comprehensive search of the latest evidence. All recommendations were supported by systematic reviews and graded using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system. Expert judgment was used to develop good practice statements supplementary to the graded evidence-based recommendations. The updated guideline comprises nine recommendations and one good practice statement. It focuses on the key recommendations pertinent to the following issues: identification of prognostic factors for death or pediatric intensive care unit admission; the use of remdesivir, systemic glucocorticoids and antipyretics, intravenous immunoglobulin (IVIG) for multisystem inflammatory syndrome in children, and high-flow oxygen by nasal cannula or non-invasive ventilation for acute hypoxemic respiratory failure; breastfeeding; vaccination; and the management of pediatric mental health. CONCLUSION: This updated evidence-based guideline intends to provide clinicians, pediatricians, patients and other stakeholders with evidence-based recommendations for the prevention and management of COVID-19 in children and adolescents. Larger studies with longer follow-up to determine the effectiveness and safety of systemic glucocorticoids, IVIG, noninvasive ventilation, and the vaccines for COVID-19 in children and adolescents are encouraged. WHAT IS KNOWN: • Several clinical practice guidelines for children with COVID-19 have been developed, but only few of them have been recently updated. • We developed an evidence-based guideline at the beginning of the COVID-19 outbreak and have now updated it based on the results of a comprehensive search of the latest evidence. WHAT IS NEW: • The updated guideline provides key recommendations pertinent to the following issues: identification of prognostic factors for death or pediatric intensive care unit admission; the use of remdesivir, systemic glucocorticoids and antipyretics, intravenous immunoglobulin for multisystem inflammatory syndrome in children, and high-flow oxygen by nasal cannula or non-invasive ventilation for acute hypoxemic respiratory failure; breastfeeding; vaccination; and the management of pediatric mental health.

An evaluation of the COVID-19 recommendation map identified diverging clinical and public health guidance.

OBJECTIVES: To describe divergence between actionable statements issued by coronavirus disease 2019 (COVID-19) guideline developers cataloged on the "COVID-19 Recommendations and Gateway to Contextualization" platform. STUDY DESIGN AND SETTING: We defined divergence as at least two comparable actionable statements with different explicit judgments of strength, direction, or subgroup consideration of the population or intervention. We applied a content analysis to compare guideline development methods for a sample of diverging statements and to evaluate factors associated with divergence. RESULTS: Of the 138 guidelines evaluated, 85 (62%) contained at least one statement that diverged from another guideline. We identified 223 diverging statements in these 85 guidelines. We grouped statements into 66 clusters. Each cluster addressed the same population, intervention, and comparator group or just similar interventions. Clinical practice statements were more likely to diverge in an explicit judgment of strength or direction compared to public health statements. Statements were more likely to diverge in strength than direction. The date of publication, used evidence, interpretation of evidence, and contextualization considerations were associated with divergence. CONCLUSION: More than half of the assessed guidelines issued at least one diverging statement. This study helps in understanding the types of differences between guidelines issuing comparable statements and factors associated with their divergence.

A multistakeholder development process to prioritize and translate COVID-19 health recommendations for patients, caregivers and the public. A case study of the COVID-19 recommendation map.

BACKGROUND AND OBJECTIVES: To develop a digital communication tool to improve the implementation of up-to-date COVID-19 recommendations. Specifically, to improve patient, caregiver and public understanding of healthcare recommendations on prevention, diagnoses and treatment. METHODS: Multi-stakeholder engagement design. In conjunction with the COVID-19 Recommendations and Gateway to Contextualization RecMap, we co-developed a stakeholder prioritization, drafting and editing process to enhance guideline communication and understanding. RESULTS: This paper presents the multi-stakeholder development process with three distinct plain language recommendation formats: formal recommendation, good practice statement, and additional guidance. Our case study of COVID-19 plain language recommendations PLRs addresses both public health interventions (e.g., vaccination, face masks) and clinical interventions (e.g., home pulse oximetry). CONCLUSION: This paper presents a novel approach to engaging stakeholders in improving the communication and understanding of published guidelines during the COVID-19 pandemic.

Which actionable statements qualify as good practice statements In Covid-19 guidelines? A systematic appraisal.

OBJECTIVES: To evaluate the development and quality of actionable statements that qualify as good practice statements (GPS) reported in COVID-19 guidelines. DESIGN AND SETTING: Systematic review . We searched MEDLINE, MedSci, China National Knowledge Infrastructure (CNKI), databases of Grading of Recommendations Assessment, Development and Evaluation (GRADE) Guidelines, NICE, WHO and Guidelines International Network (GIN) from March 2020 to September 2021. We included original or adapted recommendations addressing any COVID-19 topic. MAIN OUTCOME MEASURES: We used GRADE Working Group criteria for assessing the appropriateness of issuing a GPS: (1) clear and actionable; (2) rationale necessitating the message for healthcare practice; (3) practicality of systematically searching for evidence; (4) likely net positive consequences from implementing the GPS and (5) clear link to the indirect evidence. We assessed guideline quality using the Appraisal of Guidelines for Research and Evaluation II tool. RESULTS: 253 guidelines from 44 professional societies issued 3726 actionable statements. We classified 2375 (64%) as GPS; of which 27 (1%) were labelled as GPS by guideline developers. 5 (19%) were labelled as GPS by their authors but did not meet GPS criteria. Of the 2375 GPS, 85% were clear and actionable; 59% provided a rationale necessitating the message for healthcare practice, 24% reported the net positive consequences from implementing the GPS. Systematic collection of evidence was deemed impractical for 13% of the GPS, and 39% explained the chain of indirect evidence supporting GPS development. 173/2375 (7.3%) statements explicitly satisfied all five criteria. The guidelines' overall quality was poor regardless of the appropriateness of GPS development and labelling. CONCLUSIONS: Statements that qualify as GPS are common in COVID-19 guidelines but are characterised by unclear designation and development processes, and methodological weaknesses.

Systematic Identification and Critical Appraisal of Pediatric COVID-19 Guidelines Applicable in India.

OBJECTIVE: To systematically identify and critically appraise the methodological quality of pediatric guidelines applicable to management of COVID-19 in India. METHODS: Pediatric COVID-19 guidelines applicable to India, published until 30 April 2021, were identified through a systematic search across ten databases. Each was critically appraised for methodological quality using the AGREE-II tool, by at least two appraisers. Median (interquartile range) of the total score and domain-wise scores were calculated, and compared for Indian vs. foreign guidelines, updated vs. original versions of guidelines, and those developed earlier vs. later in the pandemic. RESULTS: A total of 62 guidelines was identified. Only 8 (12.9%) were published in India. The overall AGREE-II score ranged from 4.7% to 72.8%; with median (IQR) 37.9% (29.4, 48.6). This suggested overall low(er) methodological quality. The median (IQR) domain-wise scores were as follows: Scope and Purpose 66.7% (58.3, 83.3), Stakeholder Involvement 41.7% (30.6, 83.3), Rigor of Development 23.4% (14.8, 37.5), Clarity of Presentation 59.7% (50.0, 75.0), Applicability 27.1% (18.8, 33.3), and Editorial Independence 8.3% (0.0, 45.8). This suggested diversity in quality of different aspects of the guidelines, with very low quality in the critical domain of methodological rigor. There were no statistically significant differences in the overall scores of Indian vs. foreign guidelines, updated versions vs. original versions, and those developed earlier vs. later in the pandemic. CONCLUSION: The currently available pediatric COVID-19 guidelines have low methodological quality, adversely affecting their credibility, validity, and applicability. Urgent corrective strategies are presented for consideration.

A taxonomy and framework for identifying and developing actionable statements in guidelines suggests avoiding informal recommendations.

OBJECTIVE: To propose a taxonomy and framework that identifies and presents actionable statements in guidelines. STUDY DESIGN AND SETTING: We took an iterative approach reviewing case studies of guidelines produced by the World Health Organization and the American Society of Hematology to develop an initial conceptual framework. We then tested it using randomly selected recommendations from published guidelines addressing COVID-19 from different organizations, evaluated its results, and refined it before retesting. The urgency and availability of evidence for development of these recommendations varied. We consulted with experts in research methodology and guideline developers to improve the final framework. RESULTS: The resulting taxonomy and framework distinguishes five types of actional statements: formal recommendations; research recommendations; good practice statements; implementation considerations, tools and tips; and informal recommendations. These statements should respond to a priori established criteria and require a clear structure and recognizable presentation in a guideline. Most importantly, this framework identifies informal recommendations that differ from formal recommendations by how they consider evidence and in their development process. CONCLUSION: The identification, standardization and explicit labelling of actionable statements according to the framework may support guideline developers to create actionable statements with clear intent, avoid informal recommendations and improve their understanding and implementation by users.

Innovations to automate manual ventilation during Covid-19 pandemic and beyond.

Manual ventilation by compressing self-inflating bags is a life-saving option for respiratory support in many resource-limited settings. Previous efforts to automate manual ventilation using mechatronic systems were unsuccessful. The Covid-19 pandemic stimulated re-exploration of automating manual ventilation as an economically viable alternative to address the anticipated shortage of mechanical ventilators. Many devices have been developed and displayed in the lay press and social media platforms. However, most are unsuitable for clinical use for a variety of reasons. These include failure to understand the clinical needs, complex ventilatory requirements in Covid-19 patients, lack of technical specifications to guide innovators, technical challenges in delivering ventilation parameters in a physiological manner, absence of guidelines for bench testing of innovative devices and lack of clinical validation in patients. The insights gained during the design, development, laboratory testing and clinical validation of a novel device designated the 'Artificial Breathing Capability Device' are shared here to assist innovators in developing clinically usable devices. A detailed set of clinical requirements from such devices, technical specifications to meet these requirements and framework for bench testing are presented. In addition, regulatory and certification issues, as well as concerns related to the protection of intellectual property, are highlighted. These insights are designed to foster an innovation ecosystem whereby clinically useful automated manual ventilation devices can be developed and deployed to meet the needs associated with the Covid-19 pandemic and beyond.

Getting trustworthy guidelines into the hands of decision-makers and supporting their consideration of contextual factors for implementation globally: recommendation mapping of COVID-19 guidelines.

Published research on COVID-19 is increasing rapidly and integrated in guidelines. The trustworthiness of guidelines can vary depending on the methods used to assemble and evaluate the evidence, the completeness and transparency of reporting on the process undertaken and how conflicts of interest are addressed. With a global consortium of partners and collaborators, we have created a catalogue of COVID-19 recommendations as our direct response to the increased need for structured access to high quality guidance in the field. The COVID19 map of recommendations and gateway to contextualization (https://covid19.recmap.org) is a living project: emerging guideline literature is added on an ongoing basis, allowing granular access to individual recommendations. Building on prior work on mapping recommendations for the World Health Organization tuberculosis guidelines, a novel feature of this map is the self-directed contextualization of the recommendations using the GRADE-Adolopment approach to adopt, adapt or synthesize de novo recommendations for context specific questions. Through our map, stakeholders access the evidence underpinning a recommendation, select what needs to be contextualized and go through the steps of development of adapted recommendations. This one-stop shop portal of evidence-informed recommendations, built with intuitive functionalities, easy to navigate and with a support team ready to guide users across the maps, represents a long-needed tool for decision-makers, guideline developers and the public at large.

Clinical Profile, Hospital Course and Outcome of Children with COVID-19.

OBJECTIVES: To describe the epidemiological and clinical characteristics and outcome of hospitalized children with COVID-19 during the initial phase of the pandemic. METHODS: This was a cross-sectional descriptive study conducted at the dedicated COVID-19 hospital of a tertiary care referral center in North India. Consecutive children aged 14 y or younger who tested positive for SARS-CoV-2 by RT-PCR from nasopharyngeal swab between 1 April 2020 and 15 July 2020 were included. RESULTS: Of 31 children with median (IQR) age of 33 (9-96) mo, 9 (29%) were infants. About 74% (n = 23) had history of household contact. Comorbidities were noted in 6 (19%) children. More than half (58%) were asymptomatic. Of 13 symptomatic children, median (IQR) duration of symptoms was 2 (1-5.5) d. Fever (32%) was most common followed by cough (19%), rapid breathing (13%), diarrhea (10%) and vomiting (10%). Severe [n = 4, 13%] and critical [n = 1, 3%] illnesses were noted more commonly in infants with comorbidities. Three (10%) children required PICU admission and invasive ventilation; one died. Median (IQR) length of hospital stay was 15 (11-20) d. Follow up RT-PCR before discharge was performed in 17 children and the median (IQR) duration to RT-PCR negativity was 16 (12-19) d. CONCLUSIONS: In the early pandemic, most children with COVID-19 had a household contact and presented with asymptomatic or mild illness. Severe and critical illness were observed in young infants and those with comorbidities.

Consistency of recommendations and methodological quality of guidelines for the diagnosis and treatment of COVID-19.

OBJECTIVE: Since the beginning of the COVID-19 epidemic, a large number of guidelines on diagnosis and treatment of COVID-19 have been developed, but the quality of those guidelines and the consistency of recommendations are unclear. The objective of this study is to evaluate the quality of the diagnosis and treatment guidelines on COVID-19 and analyze the consistency of the recommendations of these guidelines. METHODS: We searched for guidelines on diagnosis and/or treatment of COVID-19 through PubMed, CBM, CNKI, and WanFang Data, from January 1, 2020 to August 31, 2020. In addition, we also searched official websites of the US CDC, European CDC and WHO, and some guideline collection databases. We included diagnosis and/or treatment guidelines for COVID-19, including rapid advice guidelines and interim guidelines. Two trained researchers independently extracted data and four trained researchers evaluated the quality of the guidelines using the AGREE II instruments. We extracted information on the basic characteristics of the guidelines, guideline development process, and the recommendations. We described the consistency of the direction of recommendations for treatment and diagnosis of COVID-19 across the included guidelines. RESULTS: A total of 37 guidelines were included. Most included guidelines were assessed as low quality, with only one of the six domains of AGREE II (clarity of presentation) having a mean score above 50%. The mean scores of three domains (stakeholder involvement, the rigor of development and applicability) were all below 30%. The recommendations on diagnosis and treatment were to some extent consistent between the included guidelines. Computed tomography (CT), X-rays, lung ultrasound, RT-PCR, and routine blood tests were the most commonly recommended methods for COVID-19 diagnosis. Thirty guidelines were on the treatment of COVID-19. The recommended forms of treatment included supportive care, antiviral therapy, glucocorticoid therapy, antibiotics, immunoglobulin, extracorporeal membrane oxygenation (ECMO), convalescent plasma, and psychotherapy. CONCLUSIONS: The methodological quality of currently available diagnosis and treatment guidelines for COVID-19 is low. The diagnosis and treatment recommendations between the included guidelines are highly consistent. The main diagnostic methods for COVID-19 are RT-PCR and CT, with ultrasound as a potential diagnostic tool. As there is no effective treatment against COVID-19 yet, supportive therapy is at the moment the most important treatment option.

Erratum to rapid advice guidelines for management of children with COVID-19.

[This corrects the article DOI: 10.21037/atm-20-3754.].